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SUMMARY 


The  objective  of  this  effort  was  to  determine  If  there  are  performance  differences  among 
pilots  accomplishing  simulated  aerial  refueling  using  five  different  visual  display 
configurations.  The  displays  were  all  used  In  the  A-10  cockpit  of  the  Advanced  Simulator  for 
Pilot  Training  (ASPT).  The  configurations  were  (a)  a  helmet-mounted  binocular  display,  (b)  lead 
lanthanum  zlrconate  tltanate  (PLZT)  goggles  (binocular)  used  with  one  channel  of  the  ASPT 
display,  (c)  a  helmet-mounted  blocular  display,  (d)  the  ASPT  300°  f leld-of-vlew  (FOV) 
dodecahedron  display,  and  (e)  the  ASPT  display  Masked  to  present  an  FOV  equal  to  that  of  the 
helmet-mounted  displays.  The  experiment  was  carried  out  In  order  to  gain  Insight  to  questions 
such  as:  Is  stereopsls  associated  with  better  performance?  Do  helmet-mounted  optics  directly  In 
front  of  the  eyes  Interfere  with  performance?  Is  wide  FOV  Important?  Is  performance  with  PLZT 
goggles  superior  to  that  with  a  helmet-mounted  stereoscopic  display? 

Forty  subjects  participated  In  this  effort:  eight  per  display  condition.  These  were  Air 
Training  Command  graduating  students  and  T-37  and  T-38  Instructor  pilots  from  the  flight  line  at 
Williams  AFB.  After  an  Initial  practice  period,  the  subject's  first  task  was  to  estimate 
distances  behind  the  refueling  tanker  while  the  A-10  was  flown  automatically  to  the  contact 
position.  Following  this,  the  pilots  flew  the  refueling  task  three  times.  Dependent  variables 
measured  were  the  oscillation  of  the  A-10  receiver  receptacle  around  the  center  point  of  the 
acceptable  refueling  boom  movement  envelope  In  three  dimensions.  The  results  show  that  the 
subject's  ability  to  estimate  distance  does  not  differ  significantly  among  the  display 
configurations.  Although  performance  measures  were  recorded  during  both  the  approach  and  contact 
phase  of  the  refueling  task,  a  computer  malfunction  negated  the  value  of  the  approach  measures. 
Measures  obtained  during  the  contact  phase  clearly  Indicate  the  value  of  a  wide  FOV  and  of 
stereoscopic  depth  cues.  Optics  In  front  of  the  eyes  were  not  shown  to  be  detrimental,  and  the 
helmet-mounted  stereoscopic  display  proved  to  be  superior  to  the  PLZT  goggles. 


PREFACE 


This  work  represents  a  portion  of  the  program  of  the  Air  Force  Human  Resources 
Laboratory  Technical  Planning  Objective  Number  3,  the  thrust  of  which  Is  Aircrew 
Training.  The  general  objective  of  this  thrust  is  to  Identify  and  demonstrate 
cost-effective  training  strategies  and  training  equipment  for  use  in  developing  and 
maintaining  the  combat  effectiveness  of  aircrew  members.  The  purpose  of  this  effort  was 
to  evaluate  the  relative  training  effectiveness  of  the  displays  considered.  The  study 
was  designed  to  answer  the  following  questions.  Is  stereopsls  beneficial?  Are  optics 
in  front  of  the  eyes  detrimental?  Is  lead  lanthanum  zlrconate  tltanate  (PLZT) 
technology  superior  to  helmet-mounted  stereosplc  displays?  The  conduct  of  this  effort 
was  made  possible  by  the  outstanding  support  of  students  and  instructor  pilots  from  the 
Air  Training  Command  02nd  Flying  Training  Wing  at  Williams  AFB.  These  personnel 
participated  in  the  experiment  In  their  free  time. 
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ADVANCED  SIMULATOR  FOR  PILOT  TRAINING  AND  HELMET-MOUNTED 
VISUAL  DISPLAY  CONFIGURATION  COMPARISONS 


I.  INTRODUCTION 

Since  the  early  1940's,  when  visual  systems  first  began  to  be  a  part  of  flight  simulation, 
there  has  been  a  desire  to  present  a  realistic  scene  containing  all  the  Information  that  pilots 
need  to  fly  their  airplanes.  This  desire  has  not  been  satisfied.  Scene-generation  equipment  has 
progressed  from  model  boards  to  complex  computer  systems  as  the  capability  to  display  more  detail 
over  wider  areas  has  advanced.  Virtual-Image  presentation  has  been  added  to  flight  simulation 
technology  as  one  method  which  can  provide  a  realistic  sense  of  volume  and  elicit  realistic  eye 
accommodation  responses.  Recent  concerns  Include  a  wider  field  of  view  (FOV)  to  allow 
presentation  of  peripheral  visual  cues  and  the  possible  benefit  It  to  be  derived  from  the 
stereoscopic  presentation  of  visual  scenes  to  provide  binocular  depth  cues  (stereopsls). 

The  latter  two  concerns  present  technological  challenges.  Increasing  the  FOV  Involves  costly 
and  complex  real-image  dome,  or  dodechedron  Infinity  optics  displays.  Also,  presentation  of  the 
visual  scene  over  a  wide  FOV  requires  considerable  computer  power,  and  providing  scene  detail  may 
tax  the  Image  generation  equipment.  Stereoscopic  presentation  requires  that  separate  Images  be 
provided  to  each  eye,  resulting  In  Image  registration  problems. 

Within  the  past  few  years,  a  technology  has  been  developed,  the  helmet-mounted  display  (HMD), 
which  permits  stereoscopic  Image  presentation  over  a  wide  FOV.  The  optics  of  such  displays  are 
mounted  on  the  pilot's  helmet.  There  Is  a  separate  set  of  optics  for  each  eye;  therefore,  the 
presentation  of  blnocularly  disparate  Images  to  each  eye  (stereo  presentation)  Is  possible. 
Although  the  Instantaneous  FOV  generated  by  the  optics  may  not  be  wide,  the  motion  of  the  pilot's 
head  Is  tracked,  and  the  visual  Image  Is  correlated  with  head  position.  Thus,  moving  the  head 
permits  the  pilot  to  view  a  wide  surround.  Problems  of  computer  capacity  are  reduced  because 
only  a  portion  of  the  FOV  (the  Instantaneous  FOV)  Is  presented  at  any  one  time.  Also,  techniques 
for  Improving  Image  registration  are  being  developed. 

Another  Interesting  recent  technological  development  Is  the  generation  of  stereoscopic  Images 
using  lead  lanthanum  zlrconate  tltanate  (PLZT)  ceramic  goggles.  Pairs  of  PLZT  shutters  are  used 
as  electronical ly  triggered  light  valves,  which  operate  180°  out  of  phase  with  SOt  duty 
cycles.  The  shutters  operate  synchronously  with  the  refresh  rate  of  a  cathode-ray  tube  (CRT)  and 
the  CRT  displays  right-eye  and  left-eye  perspectives  on  alternative  Interlaces.  These  goggles 
produce  a  strong  binocular  depth-of-f laid  sensation,  and  they  permit  essentially  unrestricted 
head  movement.  However,  there  are  drawbacks:  Transmissivity  of  the  PLZT  material  Is  less  than 
Z0(,  there  Is  a  loss  In  vertical  resolution;  and  there  Is  some  flicker,  depending  on  the  CRT 
refresh  rate  and  display  brightness. 

The  present  research  and  development  (RAD)  effort  was  conducted  to  compare  the  effectiveness 
of  the  HMDs  with  either  blocular  (same  picture  to  each  eye)  or  binocular  (stereoscopic) 
presentations  with  a  conventional  wide  FOV  CRT  display,  with  a  conventional  CRT  display  masked  to 
match  the  FOV  of  the  HMD,  and  with  a  stereoscopic  presentation  produced  with  PLZT  goggles. 
Questions  of  Interest  were:  (a)  possibility  of  cues  from  the  edge  of  a  narrow  FOV,  (b)  the 
possible  detrimental  effect  of  optics  close  to  the  eyes,  (c)  the  possible  benefit  to  be  derived 
from  a  stereoscopic  display,  and  (d)  the  comparison  of  HMD  and  PLZT  stereoscopic  displays. 
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II.  METHOD 


Tasks 

The  task  chosen  for  this  RID  was  simulated  aerial  refueling  (AR).  AR  was  selected  since  It 
allowed  all  the  research  questions.  Including  stereopsls,  to  be  addressed.  Two  AR  task 
activities  were  Included  In  the  experiment:  The  first  was  distance  estimation.  The  subjects 
were  asked  to  Indicate  when  they  believed  they  were  at  50  feet  or  at  25  feet  behind  the  tanker. 
For  this  task,  the  Advanced  Simulator  for  Pilot  Training  (ASPT)  In  the  A-10  configuration  was 
flown  automatically  (In  the  demonstration  mode)  from  100  feet  behind  the  simulated  tanker  to 
contact  with  the  boom.  Tanker  airspeed  was  205  knots,  altitude  was  ’5,000  feet. 

The  second  task  was  to  actually  fly  AR  In  the  simulator.  The  simulator  was  Initialized  at 
150  feet  behind  the  tanker,  and  the  subject's  task  was  to  fly  to  the  tanker,  achieve  contact,  and 
remain  In  contact  for  a  total  of  60  seconds  (dl {regarding  Involuntary  disconnects).  "Contact* 
means  that  the  refueling  boom  nozzle  from  the  tanker  Is  plugged  Into  the  A-lO  refueling 
receptacle  on  the  nose,  and  fuel  Is  being  transferred.  An  "Involuntary  disconnect"  occurs  when 
the  nose  of  the  A-10  departs  too  far  from  the  boom  nozzle  for  contact  to  be  maintained.  When  an 
Involuntary  dlsconnet  occurs,  the  pilot  of  the  A-10  will  maneuver  to  achieve  contact  again  and 
will  do  this  as  often  as  necessary  to  complete  refueling.  Each  subject  repeated  this  task  three 
times. 


Subjects 

Subjects  for  this  experiment  were  60  military  pilots  (6  student  pilots  and  32  Instructor 
pilots  (IPs)).  The  students  were  distributed  randomly  among  the  five  experimental  groups.  Their 
previous  flying  experience  averaged  1,280  hours  (range  from  125  to  4,800  hours).  Some  of  the 
subjects  had  previous  refueling  experience,  and  some  did  not.  Only  subjects  who  were  successful 
In  performing  a  qualifying  task  were  Included  In  the  experiment.  This  task  was  to  fly  the 
simulator  for  a  total  of  20  minutes  and  to  achieve  a  total  of  60  seconds  of  contact  time 
(disregarding  Involuntary  disconnects).  More  than  one-third  of  the  pilots  who  attempted  the  task 
were  unable  to  accumulate  the  required  60  seconds.  This  was  not  considered  to  be  Indicative  of 
less  flying  skill,  but  of  failure  to  adapt  to  the  shorten*  ngs  of  the  simulation;  l.e.,  the 
simulator  was  sensitive  In  pitch  and  roll,  and  there  was  a  lag  In  the  visual  display. 


Equipment 

The  displayed  image  used  In  this  RID  was  a  computer-generated  KC- 135  tanker  (modeled  with 
1200  edges).  Although  the  display  hardware  was  different  In  the  five  experimental  conditions, 
the  Image  displayed  was  always  the  same.  Figure  1  shows  the  KC- 135  Image  displayed  on  the  full 
FOV  of  the  ASPT.  Five  visual  display  experimental  conditions  were  used: 

1.  ASPT300:  The  full  ASPT  visual  display  which  consists  of  seven  36-Inch,  monochrome, 
1,000-line  CRTs  mounted  In  a  dodecahedron  configuration.  There  are  pentagon-shaped  In-Line 
Infinity  Optics  Systems  (1L10S),  or  Pancake  Windows,  which  collimate  the  displayed  Image  located 
In  front  of  the  CRTs.  The  FOV  of  this  display  Is  140°  vertical  by  300°  horizontal.  The 
average  brightness  of  the  ASPT  display  Is  about  1  foot-lambert. 
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Figure  1.  rc-135  displayed  on  full  ASH  FOV. 

2.  HMSD40:  The  staraoscoplc  HKD  with  a  circular  40°  FOV.  This  system  consists  of  two 

1-Inch  CRTs  (with  1,000-llna  resolution  and  a  brightness  of  10  to  20  foot-lamberts),  which  are 

■ountad  on  the  ol lot’s  halwet,  one  In  front  of  each  aye.  Figure  2  shows  the  HMD  used  In  this 
experiment.  The  CRT's  present  a  collimated,  monochrome,  40°  FOV  Image  to  each  eye.  When 

separate  right-eye,  left- eye  perspectives  are  presented,  this  40°  FOV  Is  seen 

stereoscoplcally.  The  pilot's  head  movements  are  tracked  by  magnetic-field  sensor.  This  system 
determines  the  head-pointing  direction  with  respect  to  the  cockpit. 

3.  ASPT40:  The  ASRT  display  masked  to  display  only  a  circular  40°  FOV.  The  pilot  wears 

the  helmet  with  no  optics.  This  provides  head-tracking  capability  via  magnetic  head  sensor 


located  on  the  helmet.  The  FOV  Is  slewable  by  the  magnetic  head  sensor  system  so  that  the  40° 


FOV  will  move  to  any  point  on  tfie  ASRT  display. 
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4.  HHBD40:  The  helmet-mounted  blocular  display. 
Identical  Images  are  shown  to  each  eye. 


This  Is  the  same  as  HMS040  except  that 


$.  R12T:  The  goggles  block  light  transmission  by  electronically  producing  crossed 
polarliers;  when  light  Is  to  be  transmitted,  the  polarizers  ire  made  parallel.  The  ASRT  ILlOS 
windows  also  us*  polarizers  to  control  ghosting  of  the  Image.  Thus,  In  order  for  an  1LI0S  Image 
to  be  viewed  through  RL2T  goggles,  the  1LI0S  polarization  and  the  RL2T  polarization  must  be 
parallel.  However,  the  polarizations  of  the  seven  ASRT  1LI0S  windows  do  not  have  the  same 
orientation.  For  this  reason.  It  was  possible  to  use  only  one  ASRT  window:  the  forward  one. 
The  ASRT  1L10S  windows  have  an  FOV  of  90°.  Figure  3  shows  the  RL2T  goggles. 


figure  3,  The  RLZT  goggles. 


Procedure 

The  subject,  after  arriving  to  participate  In  this  experiment,  was  first  tested  for 
storeopsls  using  a  stereoscope.  The  subject  was  sheen  a  random  dot  stereogram  and  was  asked  to 
Identify  the  central  object.  This  ess  done  for  all  subjects  and  precluded  the  possibility  that 
the  performance  of  a  subject  lacking  stereoscopic  vision  eould  be  used  to  evaluate  a  stereoscopic 
display. 

After  the  stereopsls  test,  the  purpose  of  the  RID  and  the  nature  of  the  experimental  tasks 
were  described  to  the  subjects.  They  each  read  a  short  briefing  about  AR  which  was  prepared  by 
an  AR  Instructor.  |n  the  case  of  subjects  In  the  PLZT  condition,  this  Introduction  was  given  by 
tin  experimenter  over  the  Intercom,  with  the  subject  seated  In  the  darkened  cockpit.  In  this 
way,  these  subjects  were  able  to  dark-adapt  for  about  IS  minutes  before  experimentation.  This 
was  done  to  compensate  for  the  extremely  low  Image  luminance  provided  by  the  ASPT/PLZT 
combination. 

After  the  briefing,  the  subjects  entered  the  cockpit,  which  had  the  appropriate  display,  in 
the  cockpit,  the  subject  was  first  shown  an  automatic  demonstration  of  the  AR  task.  During  this 
demonstration,  the  subject  was  kept  Informed  over  the  Intercom  as  to  the  distance  behind  the 
tanker  and  the  vertical  and  horizontal  position. 

Next,  t*>e  subject  was  allowed  to  fly  the  simulator  In  AR.  This  accomplished  two  things. 
First,  It  gave  the  subject  Initial  practice  so  that  performance  In  the  data  trails  would  be 
reasonably  stable.  Second,  It  served  as  a  qualifying  task  for  the  experiment,  as  described 
previously. 

The  subject's  next  task  was  distance  estimation.  The  simulator  demonstration  was  flown  six 
times  for  each  of  the  two  distances,  and  each  time  when  the  target  distance  was  Judged  to  have 
been  reached,  the  subject  so  indicated  hy  calling  out,  and  the  experimenter  noted  the  actual 
distance  at  that  time.  Following  this,  the  subject  flew  the  AR  task  three  times.  After  the 
session  In  tne  simulator,  each  subject  completed  a  short  questionnaire  about  conditions  which 
might  have  Interfered  with  the  performance  and  about  what  distance  cues  were  used. 
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III.  RESULTS 


Distance  Estimations 

Data  from  the  last  three  trials  of  the  two  distance  estimation  phases  (25  feet  and  50  feet) 
were  averaged  for  each  subject  and  analyzed  across  the  five  groups,  using  four  orthogonal  planned 
contrasts.  The  four  contrasts  were  as  follows: 

1.  First  group  contrast:  ASPT300  vs.  Average  of  ASPT40,  HMBD40,  HMSD40,  and  PLZT 

2.  Second  group  contrast:  Average  of  ASPT  40  and  HHBD40  vs.  Average  of  HMSD40  and  PLZT 

3.  Tnird  group  contrast:  ASPT40  vs.  HMBO  40 

4.  Fourth  group  contrast:  HMSD40  vs.  PLZT 

These  four  orthogonal  contrasts  exhaust  the  four  degrees  of  freedom  for  the  Croup  Factor. 

Table  1  shows  the  results  of  the  analysis  of  the  distance  estimates.  There  is  no  indication 
of  any  systematic  difference  in  distance  estimation  across  the  five  groups.  Overall,  subjects 
overestimated  the  distance  in  the  25-foot  condition  (mean  estimate  *  26.8  feet,  standard  error  * 
0.3  foot)  and  underestimated  the  distance  in  the  50-foot  condition  (mean  estimate  •  46.7  feet, 
standard  error  *  0.6  foot). 

Aerial  Refueling 

Although  data  were  collected  for  both  the  approach  and  attached  phases  of  the  AR  task,  a 
computer  error  destroyed  a  significant  portion  of  the  approach  data.  Analysis  of  the  remaining 
data  Indicated  that  no  additional  Information  could  be  provided  by  the  partial  data  set  obtained 
(luring  the  approach  phase  over  the  complete  data  set  obtained  during  the  attached  phase. 
Therefore,  only  the  results  obtained  from  the  attached  phase  are  presented. 

Six  performance  treasures  were  taken  during  the  attached  phase  of  the  aerial  refueling 
session.  Horizontal  Mean  Deviation  (HMD),  Horizontal  Standard  Deviation  (HSD) ,  Vertical  Mean 
Deviation  (VMD),  Vertical  Standard  Deviation  (YSD),  loom  Movement  (fore  and  aft)  Mean  Deviation 
(BMMD),  and  Boom  Movement  Standard  Deviation  (IMSD). 

Error  scores  were  computed  from  the  optimal  refueling  position  after  aircraft  attachment  to 
the  tanker  boom  was  obtained.  The  mean  deviation  and  the  standard  deviation  along  each  of  the 
three  dimensions  were  recorded  and  averaged  for  each  of  the  three  task  repetitions  (sampled  at  a 
rate  of  5  Hz).  The  three  dimensions  were  as  follows: 

1.  Horizontal  •  Mean  Deviation  (MD)  and  Standard  Deviation  (SD)  measured  In  feet,  with 
deviations  to  the  right  of  the  optimal  position  assigned  a  positive  value  and  deviations  to  the 
left  assigned  a  negative  value. 

2.  Vertical  -  MD  and  SD  measured  In  feet,  with  deviations  above  the  optimal  position 
assigned  a  positive  value  and  deviations  below  the  optimal  position  assigned  a  negative  value. 

3.  Fore-and-Aft  (Boom  Movement)  -  MD  and  SD  measured  In  feet,  with  deviations  from  the 
optimal  position  In  the  direction  of  the  tanker  assigned  a  positive  value  and  deviations  away 
from  the  tanker  assigned  a  negative  value. 
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Table  1.  Analysis  of  Olstance  Estimates 


Effect 

Wllk's 

Approx.  F  (2,  34) 

£ 

MANOVA4  of  Olstance 

Estimates  Across  Groups 

1st 

Group 

Contrast 

.948 

0.928 

.405 

2nd 

Group 

Contrast 

.965 

0.610 

.549 

3rd 

Group 

Contrast 

.972 

0.498 

.612 

4th 

Group 

Contrast 

.947 

0.948 

.397 

df 

HS 

F(  1,  35) 

_P 

ANOVA6 

of  Distance 

Estimates 

at  25  feet 

1st  Group  Contrast 

1 

5.366 

1.173 

.286 

2nd  Group  Contrast 

1 

1.088 

0.238 

.629 

3rd  Group  Contrast 

1 

0.076 

0.017 

.898 

4th  Group  Contrast 

1 

5.760 

1.259 

.269 

Within  Groups  Error 

35 

4.575 

.... 

ANOVA  Of 

Olstance 

Estimates  at 

50  feet 

1st  Group  Contrast 

1 

9.900 

0.729 

.399 

2nd  Group  Contrast 

1 

13.781 

1.014 

.321 

3rd  Group  Contrast 

1 

13.690 

1.008 

.322 

4th  Group  Contrast 

1 

9.303 

0.685 

.414 

Within  Groups  Error 

35 

13.588 

---- 

•Hultlple  Analysis  of 

Variance 

• 

Analysis  of  Variance. 


The  HO  measurements  provided  a  measure  of  bias  (l.e.,  whether  or  not  a  subject  tended  to  be 
off  In  one  direction),  whereas  the  SO  measurements  provided  a  measure  of  consistency  (l.e.,  how 
well  an  individual  was  able  to  maintain  a  constant  position  relative  to  the  tanker). 

The  six  response  variables  (HHO,  HSO,  VMO,  VSO,  BHHO,  and  BHSO)  wire  analyzed  using  the  same 
set  of  planned  orthogonal  contrasts  that  were  used  In  the  analysis  of  the  distance  estimates. 
Table  2  presents  the  results  of  the  multivariate  analysis  across  groups.  Tables  3,  4,  and  S 
present  the  results  of  the  univariate  tests. 

The  multivariate  tests  clearly  Indicate  significance  for  the  first  (ASPT300  vs.  AS?T  40, 
HHB040,  and  HHSD40,  and  PLZT)  and  second  (ASPT40  and  HHBD40  vs.  HHS040  and  PLZT)  group  contrasts 
(p  •  .007  and  p  •  .030,  respectively). 

The  significance  of  the  first  multivariate  group  contrast  appears  to  be  due  to  a  greater 
ability  to  maintain  horizontal  position  for  the  ASPT300  group  as  compared  to  the  other  four 
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groups.  This  Is  evidenced  by  the  significant  univariate  test  for  HSD:  F ( 1 , 35 )  =  17.702,  p< 
.0005.  The  significance  of  the  second  multivariate  group  contrast  appears  to  be  due  to  a 
difference  In  approach  bias  as  evidenced  by  the  significant  univariate  test  for  BMMD  (F ( 1.35)  * 
9.360,  p  =  .004).  Subjects  In  all  four  of  these  groups  (ASPT40,  HMBD40,  HMSD40,  and  PLZT)  tended 
to  approach  too  close  to  the  tanker.  However,  subjects  In  the  binocular  conditions  (HMSD40  and 
PLZT)  were  closer  to  the  optimum  boom  position  than  were  subjects  In  the  two  blocular  conditions 
(ASPT40  and  HHBD40).  It  Is  also  Interesting  to  note  that  the  bias  for  the  two  binocular  groups 
(HMSD40  and  PLZT)  Is  not  significantly  different  from  zero.  Figure  8  demonstrates  this  result. 
Figures  4  through  9  present  plots  of  the  95*  confidence  Intervals  for  the  five  groups  on  each  of 
the  six  performance  measures. 


Table  2.  Multivariate  An.  ’ysls  of  Performance  Measures 


Effect 

Wllk's 

Approx.  F  (6,  30) 

_P 

MANOVA  Across  Groups  of 

Horizontal  MD  &  SD; 

Vertical  MD  S  SD;  Boom 

Movement  MD  &  SD 

1st  Group 

Contrast 

.574 

3.714 

.007 

2nd  Group 

Contrast 

.645 

2.750 

.030 

3rd  Group 

Contrast 

.840 

0.952 

.473 

4th  Group  Contrast 

.708 

2.061 

.088 

Table  3. 

Univariate  Analysis  Horizontal  Measures 

Effect 

df 

MS 

Fd.  35) 

P. 

Horizontal 

Mean  Deviation 

1st  Group  Contrast 

1 

0.260 

0.155 

.696 

2nd  Group  Contrast 

1 

5.453 

3.253 

.080 

3rd  Group  Contrast 

1 

2.608 

1.556 

.221 

4th  Group  Contrast 

1 

2.775 

1.656 

.207 

Within  Groups  Error 

35 

1.676 

---- 

Horizontal  Standard 

Deviation 

1st  Group  Contrast 

1 

5.182 

17.702 

<.0005 

2nd  Group  Contrast 

I 

0.212 

.725 

.400 

3rd  Group  Contrast 

1 

0.142 

.485 

.491 

4th  Group  Contrast 

1 

0.260 

.889 

.352 

Within  Groups  Error 

35 

0.293 

---- 
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Table  4.  Univariate  Analysis  Vertical  Measures 


Effect 


df 


MS 


F(l,  35) 


Vertical  Mean  Deviation 


1st  Group  Contrast 

1 

0.006 

0.003 

.959 

2nd  Group  Contrast 

1 

0.048 

0.021 

.886 

3rd  Group  Contrast 

1 

1.275 

0.549 

.464 

4th  Group  Contrast 

1 

0.020 

0.009 

.927 

Within  Groups  Error 

35 

2.323 

.... 

Vertical 

Standard  Deviation 

1st  Group  Contrast 

1 

0.008 

0.024 

.877 

2nd  Group  Contrast 

1 

0.002 

0.007 

.935 

3rd  Group  Contrast 

1 

1.214 

3.608 

.066 

4th  Group  Contrast 

1 

0.004 

0.012 

.915 

Within  Groups  Error 

35 

0.336 

.... 

Table  5.  Univariate  Analysis  Booh  Movement  Measures 


Effect 

df 

MS 

F(l,  35) 

£ 

Boom  Movement 

Mean 

Deviation 

1st  Group  Contrast 

1 

0.270 

0.325 

.572 

2nd  Group  Cortrast 

1 

7.759 

9.360 

.004 

3rd  Group  Contrast 

1 

0.047 

0.057 

.813 

4th  Group  Contrast 

1 

0.065 

0.079 

.781 

Within  Groups  Error 

35 

0.829 

Boom 

Movement 

Standard 

Deviation 

1st  Group  Contrast 

1 

0.027 

0.309 

.562 

2nd  Group  Contrast 

1 

0.208 

2.390 

.131 

3rd  Group  Contrast 

1 

0.001 

0.003 

.960 

4th  Group  Contrast 

1 

0.737 

6.465 

.006 

Within  Groups  Error 

35 

0.067 

---- 

ASPT300 


ASPT40 


HMBD40 


HMSD40 


PLZT 


Figure  4  -  Horizontal  Mean  Deviation 

Group  plots  of  95%  Confidence  Intervals 
Positive  sign  indicates  to  the  right  of  *Se 
optimal  horizontal  position. 

X  =  Group  Mean  Standard  Error  =  0.5  ft. 


ASPT40 


HMBD40 


HMSD40 


Figure  5  -  Horizontal  Standard  Deviation 

Group  plots  of  95%  Confidence  Intervals 
X  =  Group  Mean  Standard  Error  =  0.2  ft 


ASPT300  HMBD40  PLZT 

ASPT40  HMSD40 


Figure  6  -  Vertical  Mean  Deviation 

Group  plots  of  95%  Confidence  Intervals 
Positive  sign  indicates  above  the  optimal 
vertical  position 

X  =  Group  Mean  Standard  Error  =  0.5  ft. 
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ASPT300 


ASPT40 


HMBD40 


HMSD40 


PLZT 


Figure  7  -  Vertical  Standard  Deviation 

Group  plots  of  95%  Confidence  Intervals 
X  s  Group  Mean  Standard  Error  =  0.2  ft. 


ASPT300 


ASPT40 


HMBD40 


HMSD40 


Figure  8  -  Boom  Movement  Mean  Deviation 

""Group  plots  of  95%  Confidence  Intervals 
Positive  sign  indicates  in  front  of  the 
optimal  boom  position. 

X  s  Group  Mean  Standard  Error  =  0.3  ft. 


Standard  Deviation  in  ft. 
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ASPT300 


ASPT40 


HMBD40 


HMSD40 


PLZT 


Figure  9  -  Boom  Movement  Standard  Deviation 
Group  plots  of  95%  Confidence  Intervals 
X  =  Group  Mean  Standard  Error  =  0.1  ft. 
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The  ability  to  control  the  boom  position  does  not  appear  to  be  as  great  for  the  subjects  In 
the  PLZT  group  as  for  subjects  In  the  HMSD40  group,  as  Indicated  by  the  significant  fourth 
univariate  contrast  for  BMSD:  F(1,35)  *  8.465,  p  *  .006.  Though  the  multivariate  test  of  this 
contrast  does  not  quite  obtain  the  customary  level  of  significance,  a  Bonferronl  test  of  six 
comparisons  would  require  a  p  less  than  .0083  for  significance  at  the  customary  .05  level  (Neter 
6  Wasserman,  1974).  Thus,  It  appears  that  this  difference  Is  systematic. 

In  summary.  It  was  observed  that  subjects  In  the  wide  FOV  condition  (ASPT300)  had  a  greater 
amount  of  control  over  their  horizontal  position  as  measured  by  the  HSD.  The  HSD  was  0.9  foot 
less,  on  tne  average,  for  subjects  In  the  ASPT300  condition  than  the  average  for  the  other  four 
groups.  The  difference  between  the  binocular  (HMSD40  and  PLZT)  and  blocular  ( ASPT40  and  HMB040) 
conditions  was  reflected  (n  a  decrease  In  BMMD  of  about  1.0  foot.  The  observed  bias  In  the 
blocular  conditions  was  approximately  three  times  that  of  the  binocular  conditions.  Finally,  It 
appeared  that  control  of  boom  position  was  not  as  great  for  the  HZT  group  as  It  was  for  the 
HMSD40  group,  as  reflected  by  the  observed  0.4-foot  difference  In  BMSD  between  the  two  groups. 


Questionnaires 


Table  6  shows  how  the  pilots  responded  to  the  questionnaire  Items. 


Table  6.  Questionnaire  Responses 


HMSD40 


HMBD40  ASPT300  ASPT40 


PLZT  TOTAL 


IV.  DISCUSSION 


Distance  Estimations 

The  distance  estimations  revealed  no  differences  among  the  display  conditions.  It  Is  not 
surprising  to  note  that  the  distance  estimation  function  Is  compressed:  The  50-foot  estimates 
were  consistently  too  short,  and  the  25-foot  estimates  were  consistently  too  long.  This  Is 
congruent  with  the  findings  of  DeMalo,  Rlnalduccl,  Brooks,  &  Brunderman  (1983),  who  Investigated 
altitude  estimation. 


Aerial  Refueling 

Three  of  the  contrasts  mentioned  In  the  results  section  of  this  report  reached  Interesting 
probability  levels,  and  they  also  provide  some  Insight  to  the  relative  merits  of  the  displays 
that  were  Investigated.  The  results  Indicate  that  horizontal  control  (as  measured  by  HSD)  with 
the  full  FOV  (ASPT300)  Is  superior  to  all  of  the  other  four  configurations.  In  the  ASRT300 
condition,  the  pilots  were  better  able  to  perceive  their  position  relative  to  the  optimal 
horizontal  boom  position.  However,  this  finding  should  not  deter  designers  from  considering 
narrow  FOV  displays  for  the  A-10  refueling  task,  since  the  differences  Involved  do  not  remove  the 
aircraft  from  the  acceptable  envelope  of  boon  movement.  The  largest  group  difference  with  ASPT 
300  Is  that  observed  with  HHBD40,  which  Is  only  about  1.1  feet.  Furthermore,  HHD  ( 1 . e . ,  how  well 
the  A-10  was  aligned  with  the  tanker's  centerline)  Is  not  different  for  ASPT300  when  compared 
with  the  average  of  the  other  displays. 

The  second  significantly  different  contrast  might  Interest  designers  of  aerial  refueling 
part-task  trainers.  There  Is  Indication  that  stereopsls  aids  control  when  the  aircraft  Is 
attached  to  the  refueling  boom.  Results  show  that  the  two  stereoscopic  displays  (HMSD40  and 
PLZT)  were  definitely  superior  to  the  40°  FOV  blocular  displays  (ASPT40  and  HMBD40)  In  fore  and 
aft  controls  the  group  difference  In  BMMO  Is  approximately  1  foot.  On  the  average,  the  blocular 
groups  were  about  1  foot  further  from  optimum  boom  extension  than  were  the  binocular  groups. 
(Subjects  In  the  blocular  groups  -  ASPT40  and  HMBD40  -  approached  to:  close  to  the  tanker.) 
Since  simulator  tolerance  for  this  distance  before  Involuntary  disconnect  was  3.125  feet,  the 
actual  task  of  refueling  was  not  adversely  affected  by  Increased  disconnects.  Horizontal  error, 
as  measured  by  HMD,  was  sllghlty  better  for  the  blocular  displays.  The  contrast  almost  reached 
the  .05  significance  level.  This  superiority  of  the  blocular  displays  was  most  likely  due  to  the 
large  error  obtained  by  the  PLZT  group,  which  probably  resulted  from  the  reduced  luminance 
obtained  with  the  PLZT/ASPT  combination  rather  than  from  the  presence  of  binocular  cues.  This 
conclusion  is  strengthened  by  the  Identical  HMD  means  obtained  for  the  ASPT40  (blocular)  and 
HMSD40  (binocular)  groups  (see  Figure  4). 

The  third  significantly  different  contrast  was  that  of  the  two  stereoscopic  displays:  HMSD40 
and  PLZT.  The  BMSD  was  less  with  the  HMSD40,  Indicating  better  fore  and  aft  control. 
Apparently,  the  decreased  vertical  resolution  and  luminance  and  the  flicker  of  the  PlZT  goggles 
detracted  from  the  benefit  of  the  stereoscopic  display.  Again,  this  does  not  seem  to  be  of 
practical  Importance;  the  difference  In  variation  was  orly  about  5  inches. 


Questionnaires 

The  questionnaires  werj  directed  exclusively  to  the  visual  display  aspect  of  the  simulation. 
Some  of  the  questions  applied  to  only  some  of  the  conditions.  Thus,  responses  by  the  ASPT300 


group  did  not  Indicate  difficulty  with  the  helmet,  optics,  or  FOV.  The  ASPT30Q  group  did  not 
Indicate  difficulty  with  visual  lag  either,  although  the  lag  between  control  Inputs  and  visual 
display  response  In  this  condition  was  ISO  milliseconds.  Lag  In  the  HMD  conditions  and  ASPT40 
was  greater  than  ISO  milliseconds  because  of  the  head  tracker,  but  still,  the  number  of  pilots 
Indicating  difficulty  was  minimal.  This  probably  does  not  mean  that  display  lag  was  not  a 
problem,  but  rather  the  lack  of  difficulty  was  the  result  of  the  pilots  having  to  qualify;  that 
Is  the  pilots  whose  performance  was  affected  too  adversely  by  lag  did  not  qualify.  Optics  close 
to  the  eyes  was  not  a  problem;  performance,  as  well  as  questionnaire  data,  shows  that  this  Is  the 
case.  Additional  debriefing  revealed  that  the  alignment  of  helmet  optics  Is  a  problem.  Several 
pilots  reported  that  they  had  seen  a  double  Image  of  their  Heads-up  Display  (HUD)  when  looking 
through  the  HMD  beamsplitters.  This  would  happen  If  pilots  had  adapted  to  faulty  alignment  of 
the  optics  when  the  HMD  was  adjusted  by  converging  or  diverging  their  eyes.  Pilots  also  reported 
difficulty  seeing  cockpit  Instruments  through  the  HMD  beamsplitters. 

Debriefing  revealed  that  the  boom  size  relative  to  the  HUD  was  an  Important  cue  In  addition 
to  those  listed  In  the  questionnaire.  It  Is  Interesting  that  FOV  boundary  was  not  used  more, 
perhaps  because  it  was  neither  a  sharp  boundary  nor  fixed  In  space.  Finally,  there  Is  some 
discrepancy  between  performance  and  the  Infrequent  use  of  the  stereoscopic  Image  as  a  cue  (as 
Indicated  In  Table  6).  Performance  measures  showed  that  pilots  with  stereoscopic  displays  flew 
better  during  the  attached  portion  of  the  task.  Stereoscopic  cues  must  have  been  used  without 
conscious  awareness. 


V.  CONCLUSION 

This  experiment,  performed  In  the  context  of  the  AR  task,  has  provided  answers  to  the 
questions  which  originally  prompted  It.  First,  the  presence  of  optics  close  to  the  eyes  with  an 
HMD  does  not  adversely  affect  performance;  there  were  no  performance  differences  between  ASPT40 
and  HHBD40.  Second,  the  boundary  of  a  limited  FOV  display  apparently  does  not  provide  useful 
cues,  since  performance  was  better  with  ASPT300.  Third,  stereopsls  does  provide  cues  which  aid 
aircraft  control  at  relatively  close  distances. 
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